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Customer  Service: 


Practical  Marketing  Research: 
Measurement  of  Customer  Satisfaction  and  Change 


1.  Management  bv  Facts:  The  Need  for  Information 

The  purpose  of  this  paper  is  twofold.  First,  it  is  to  outline  the  growing  need  for  market 
research  and  customer  satisfaction  measurements,  including  cost  considerations  in  general,  to 
provide  senior  management  with  a  basis  for  understanding  the  processes  involved.  Second,  it 
is  to  fill  the  current  dearth  in  the  literature  of  discussions  on  customer  satisfaction 

questionnaire  development  and  use. 

Many  experts  have  written  articles  and  books  about  the  importance  of  customer  service 
for  competing  in  business  today.  Most  of  these  authors  generally  concur  that  customer 
satisfaction  is  an  important  factor  for  the  successful  business  and  that  customer  perceptions 

and  attitudes  should  be  assessed  and  monitored. 

In  the  early  Eighties,  business  learned  important  new  skills  for  identifying  and  satisfying 
its  customers.  Inevitably,  this  experience  led  to  the  recognition  that  the  needs  of  internal  work 
processes  and  internal  customers  were  critical  to  external  service  delivery.  Faced  with  growing 
spending  constraints,  a  similar  awareness  of  the  practical  benefits  from  increased  commitment 
to  customer  service  also  began  to  emerge  within  the  Ontario  government  environment. 

The  Ministry  of  Revenue  has  for  a  number  of  years  been  strongly  committed  to  providing 
superior  customer  service  to  its  diverse  groups  of  taxpayers.  With  the  growing  impact  of  global 
competition  on  the  private  sector  and  spending  constraints  imposed  on  government,  a  shift  is 
taking  place,  moving  from  merely  serving  the  customer  to  satisfying  or  exceeding  their  needs. 
The  1991  Ontario  Customer  Service  Task  Force  survey  of  both  the  public  and  members  of  the 
OPS  provided  some  evidence  of  this  shif t  f rom  customer  service  to  a  growing  need  to  desire  for 
customer  satisfaction. 

Satisfying  customer  needs  requires  that  the  service  parameters  and  quality  expectations 
are  known  in  the  first  place.  Similarly,  the  degree  of  success  in  meeting  those  needs  must  also 
be  identified  and  monitored,  to  ensure  that  resources  are  used  efficiently.  Market  research 
methods  are  employed  to  obtain  the  information  to  satisfy  both  of  these  needs.  Although  the 
process  demands  accuracy  in  sampling  and  processing  to  provide  reliable  information, 
acquiring  feedback  from  marketing  research  is  relatively  simple,  although  not  always  easy. 

While  some  of  the  following  information  derived  from  Revenue’s  experience  will  be 
useful  for  managing  small  surveys  in  other  Ontario  Government  ministries,  it  will  be  equally 
useful  in  providing  senior  managers  with  the  knowledge  and  understanding  required  for 
discussing  market  research/feedback  needs  with  their  suppliers.  Consistent  with  the  prevailing 
constraint  on  spending  and  the  growing  need  to  "do  more  with  less,"  the  emphasis  throughout 
this  presentation  also  embraces  customer  service  quality  improvement: 


"Doing  The  Right  Thing" 


and 

"Getting  It  Right  The  First  Time" 


2. 


The  Five  C’s  of  Customer  Satisfaction 


The  treatment  of  customer  satisfaction  measurement  is  here  based  on  the  standard  principles 
of  marketing,  which  aim  for  an  optimum  of  repeat  business  through  customer  satisfaction, 
within  stated  resource  limitations  to  protect  the  ultimate  profit  motive.  This  objective  is 
usually  achieved  through  employment  of  marketing  research  and  performance  tracking,  or 

feedback. 


In  planning  for 
optimum  levels 
of  customer 
satisfaction, 
the  following 
five  criteria 
must  be 
addressed  with¬ 
in  a  balanced 
framework. 
The  sixth,  pro¬ 
vides  the  basis 
for  measuring 
and  monitoring 
of  customer 
satisfaction 
levels.  To  date, 
owing  to  the 
complex  struc¬ 
ture  of  cus¬ 
tomer  service, 
there  are  very 
few  reference 
works  dealing 

specifically  with  the  practical  aspects  of  customer  satisfaction  measurement  as  such. 


The  Five  C's  of  Customer  Satisfaction 

Action: 

The  Tools : 

+ 

Confirm  Needs! 

Market  Research,  Feedback 

+ 

Co-ordinate! 

Balanced  Business  Approach 

+ 

Communicate! 

Marketing  Orientation 

+ 

Consider  Service! 

Customer  Orientation 

+ 

Compete! 

Quality  Improvement 

= 

Customer  Satisfaction 

Performance  Measurement 

a.  Confirm  vour  customers’  or  taxpayers’  Needs! 

Successful  service  organizations  understand  the  profiles,  very  basic  needs,  priorities, 
motivations  and  expectations  of  their  customers. 

b.  Coordinate  All  Resources! 


With  functionalization  employed  in  most  large  organizations,  effective  internal 
communications  are  required  to  ensure  best  concentration  of  effort,  so  that. optimum 
benefit  is  derived  from  all  resources  employed. 

c.  Communicate! 


The  importance  of  communications  with  both,  internal  and  external  customers  cannot  be 
over-emphasized.  This  requirement  is  vital  for  ensuring  that  emphasis  is  placed  on 
"Doing  the  Right  Thing,"  rather  than  on  "Doing  Things  Right." 
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d. 


Consider  Service! 


The  importance  of  "front-line"  customer  service  has,  thanks  to  well  known  proponents, 
such  as  Karl  Albrecht,  Tom  Peters,  Jan  Carlzon  and  others,  been  given  much  emphasis  in 
recent  years.  Regardless  of  the  quality  of  the  front-line  service,  this  cannot  produce 
customer  satisfaction  in  isolation  unless  the  core  service  or  product  is  also  what  the  cus¬ 
tomer  wants  to  begin  with. 

e.  Compete  with  Service  Quality! 

Today,  change  has  becoming  a  way  of  life  for  successful  businesses.  Competing  for  their 
share  of  often  declining,  markets  with  fewer  spending  dollars,  they  are  searching  for 
more  innovative  ways  to  satisfy  their  customers,  in  order  to  survive  and  thrive.  Quality 
improvements  are  thus  driven  largely  by  competition.  In  government,  the  ’risk’  of 
privatization  can  have  a  similar  effect. 

Traditionally,  government  did  not  have  to  contend  with  competition  and  the  ’quality 
movement’  was  considered  a  ’passing  fad’  by  many.  Faced  with  spending  constraints,  and  the 
need  for  most  efficient  use  of  resources,  the  logic  and  benefits  from  quality  IMPROVEMENT 
apply  increasingly  to  government  as  well. 


3.  The  Measurement  of  Customer  Satisfaction 

Successful  businesses  have  learned  how  to  apply  the  principles  of  marketing,  with  their  central 
focus  on  "satisfying  or  exceeding  customers’  expectations,  so  that  they  will  become  loyal 
customers."  Marketing  research,  performance  tracking  or  feedback  play  an  important  role  in 
addressing  all  the  above  criteria  and  in  achieving  the  desired  success. 

Ontario  Government  ministries  also  want  to  satisfy  their  customers  with  the  services 
provided.  While  the  elements  of  choice  or  repeat  business  are  not  as  evident,  here  the  need  to 
have  the  public  respond  to  a  statute  in  a  certain  manner  can  be  achieved  with  the  same 
approach.  Therefore,  it  follows  that  government  can  benefit  from  applying  the  same  principles 
that  have  worked  well  for  successful  businesses. 

To  determine  our  success  in  satisfying  taxpayers  or  customers  and  their  needs,  it  is 
essential  to  establish  a  mechanism  for  identifying  their  needs  or  concerns  in  the  first  place. 
Once  the  program  gets  under  way  the  same  process  is  used  for  measuring  our  success  in  meeting 
these  needs.  While  the  process  of  determining  our  customers’  or  taxpayers’  needs  at  the  outset 
is  relatively  easy,  measurement  of  satisfaction  becomes  more  difficult  owing  to  the  functional¬ 
ized  structure  of  most  ministries. 

Before  we  proceed  it  is,  however,  worth  noting  that  the  problem  with  "customer 
satisfaction"  measurement  is  that  it  cannot  be  measured  in  isolation.  In  the  competitive 
business  world,  it  is  as  important  to  know  about  your  competitors’  clients  almost  as  much  as 
about  your  own  -  to  be  fully  effective.  Lack  of  this  total  information  will  often  prevent  any 
meaningful  comparisons  and  improvements,  but  -  it  can  be  done! 

To  this  end,  it  is  important  to  understand  the  role  of  marketing  research  and  feedback 
as  part  of  the  ongoing  business  process.  From  that  development  you  will  see  why  measurement 
of  customer  satisfaction  levels  must  be  linked  to  their  original  needs  or  wants  on  one  hand,  and 
the  reasons  for  their  satisfaction  and  dissatisfaction  on  the  other. 
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4. 


The  traditional  Role  of  Marketing  Research  and  Feedback 


Briefly  stated,  the  role  of  marketing  research  and  feedback  is  to  support  the  business’  need  to 
operate  profitably  and  at  optimum  efficiency  while  satisfying  or  exceeding  its  customers’ 
needs,  by  identifying  and  tracking: 


a.  Customers’  needs  and  expectations 

In  the  traditional  -  customer  oriented  -  marketing  model,  marketing  research  or  feedback 
plays  a  significant  role  in  (1)  identifying  the  customers’  needs  and  wants,  and  (2)  measure 
and  track  feedback  from  customers  to  measure  their  satisfaction  in  meeting  these  needs. 


b.  Identifying  changes  and  trends 

Today  most  business  is  conducted  in  a  highly  competitive,  changing  environment.  The 
successful  business  must  detect  any  changes  that  impact  on  its  business,  such  as  changes 
in  customer  relationships.  Tracking  research  is  used  to  monitor  customer  satisfaction 
levels  and  changing  trends,  as  part  of  an  ongoing  feedback  program. 

Since  the  business  -  customer  relationship  is  also  dependent  on  suppliers  and  staff, 
the  definition  of  "customer"  must  essentially  include  both  the  external  and  internal 
customers,  where  suppliers  and  agents  may  function  in  dual  roles. 


c.  The  competition,  their  customers,  and  its  impact  on  service  quality 

In  the  private  sector,  quality  improvements  of  both  product  and  services  are  generally 
motivated  or  "driven"  by  competition.  In  this  context,  from  a  customer’s  perspective, 
competition  is  healthy  and  good.  Since  the  impact  of  competition  is  becoming  more 
globalized  and  a  growing  amount  of  innovation  originates  from  a  transfer  of  ideas  from 
one  application  to  another,  the  need  for  monitoring  the  business  environment  -  to 
identify  threats  and  opportunities  -  is  also  increasing. 

Tracking  these  changes  through  research  and  learning  how  they  affect  the  average 
taxpayer,  will  also  enable  government  to  benefit  in  many  ways,  by  adapting  more 
competitive  practices  in  its  search  for  alternative  solutions,  "doing  more  with  less". 


d.  Target  markets  and  segments  with  specific  needs 

Traditionally,  marketing  managers  occupied  themselves  with  satisfying  customers 
broadly  specified  needs,  and  applied  mass  marketing  techniques  through  advertising  and 
promotion.  With  the  growing  impact  of  technology  and  the  current  trend  towards  more 
individualization  of  customer  service,  identification  of  market  segments  with  specific 
needs  is  also  becoming  increasingly  more  important. 

Applied  to  government  and  law  enforcement,  the  ideal  of  one  law  fits  all  is  giving 
way  to  identifying  methods  to  ease  the  burden  of  compliance  by  taking  into  account 
specific  taxpayer/customer  needs  and  responding  to  these  in  such  areas  as  language  and 
jargon  used,  forms  design  and  instructions.  Compliance  level  may  be  increased  by 
applying  market  segmentation  here,  too. 
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4.  The  traditional  Role  of  Marketing  Research,  continued: 

e.  Preferred  distribution  channels,  to  ensure  best  use  of  communications  media 

For  the  most  cost-effective  use  of  the  communications  media,  it  is  essential  to  know  the 
information-receiving  preferences  among  target  audiences.  This  need  in  turn  requires 
a  detailed  understanding  of  the  readerships  of  print  media,  television  and  radio 
audiences,  and  other  media  preferences  to  ensure  that  the  most  appropriate  medium  or 
promotion  mix  is  used.  Again,  with  population  changes  in  life  styles  and  preferences,  it 
is  also  desirable  to  be  aware  of  shifts  in  the  resulting  trends. 

f.  Customer  service  delivery 

Even  the  best  customer  service  based  on  internal  perceptions  alone  can  fail  to  satisfy,  if 
it  doesn’t  match  the  customers’  needs  or  expectations.  Where  customer  satisfaction  is 
critical,  only  the  customers  or  taxpayers  can  judge  the  quality  of  service  that  pleases 
them. 

g.  Customer  satisfaction  levels  and  trends 

The  actual  delivery  of  customer  service  is  an  intangible  element  that  is  also  prone  to 
change.  It  may  be  tempting  at  first  to  blame  any  change  on  customers,  but  independent 
feedback  may  prove  otherwise.  The  change  may  be  due  to  competitive  business  forces 
or  the  impact  of  other  external  influences,  since  even  the  best  customer  service  is  likely 
to  change  with  time.  To  ensure  that  desired  service  levels  are  maintained,  there  is  a  need 
for  routine  feedback. 
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5. 


The  Application  of  Feedback  -  What’s  in  it  for  Government? 


In  the  business  application,  marketing  research  and  communications  work  very  closely  together. 
Without  good  research  and  understanding  of  the  characteristics  of  target  market  needs, 
effective  communications  are  limited.  With  government  applications,  however,  the  relationship 
has  been  changing,  even  though  we  have  some  way  to  go  to  catch  up  with  the  commercial 
model.  Let  me  illustrate  briefly  what  happens  when  market  feedback  and  communications 
work  well  together,  but  first:  How  it  used  to  be: 

a.  The  Traditional  Government  Program  Model 

For  example,  consider  the  functional  approach  used  in  taxation.  Chart  1  below  illustrates 
the  traditional  government  approach  to  implementing  a  program  until  about  fifteen  or 
so  years  ago.  At  that  time,  there  was  no  reference  to  public  consultation,  nor  any  formal 
recognition  of  CUSTOMERS’  -  or  taxpayers’  -  NEEDS.  At  that  time,  ’ignorance  of  the 
Law’  was  usually  unacceptable  as  reason  for  non-compliance,  but  error  rates  were  high. 


Limited  Feedback 


Chart  1  -  Traditional  Approach  to  Program  Delivery  -  without  Feedback 


Traditionally,  this  "gap"  in  understanding  was  compounded  by  a  general  attitude  among 
’establishment’,  including  government  and  banks,  that  their  employees  were  infallible. 
Any  error  would  thus  have  to  be  the  customers’  fault.  Note  the  functional  approach  to 
program  delivery. 

Without  systematic  feedback  from  customers  or  taxpayers  and  effective  internal 
communications,  many  functions  were  performed  in  isolation  from  one  another. 
Exceptions  had  to  be  dealt  with  in  some  functional  areas  without  ever  detecting  their 
sources.  As  functional  service  became  more  specialized,  so  grew  the  tremendous 
opportunities  for  "doing  things  right,",  with  few  incentives  for  "doing  the  right  thing." 
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5. 


The  Application  of  Feedback,  continued: 


a.  The  Traditional  Program  Model,  continued: 

Without  the  needed  feedback  to  determine  the  taxpayers’  needs  and  priorities,  it  was 
impossible  to  evaluate  the  success  of  customer  service  or  determine  satisfaction  levels. 
Consequently,  error  rates  were  high. 

b.  The  Importance  of  Two-Way  Communications 

Now  let  us  look  at  the  contribution  expected  from  communications  in  the  marketing 
model,  as  illustrated  in  Chart  2  below: 


MARKETING  FORCES 

(Moving  prospective  Clients  to  support  Business,  Advertising  and 
Promotion,  Product  Appeal,  Superior  Customer  Service  Quality) 


COUNTERVAILING  FORCES 
(Competition,  complex  Price  Structure,  Forms  &  Instructions, 
Procrastination,  Resistance  to  Buying  or  Compliance,  Market  Attrition) 


Chart  2  -  Results-oriented  Marketing  Communications 

When  a  program  or  service  is  introduced,  the  first  step  is  to  ’inform  the  public’  and 
’create  awareness.’  In  marketing  practice,  the  acronym  "AIDA"  (awareness,  interest, 
desire,  action)  became  popular  at  the  turn  of  the  century,  to  remind  us  that  ’informing’ 
is  not  ’communicating.’  —  ’Providing  information’  means  getting  the  message  out,  while 
’communicating’  is  ’getting  through.’  As  any  parent  will  testify,  there  is  indeed  a 
difference.  The  evaluation  of  promotional  effectiveness  through  feedback  is  often 
confined  to  testing  the  public’s  recall,  graphic  impression  and  readability  of  the 
promotional  piece,  focusing  on  ’how  does  it  look?’ 
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5. 


The  Application  of  Feedback,  continued: 


b.  Two-Wav  Communications,  continued: 

However,  where  ACTION  --  that  is  TOTAL  COMPLIANCE  in  Revenue’s  case  --  is 
required,  this  approach  is  unlikely  to  produce  optimum  results. 

For  most  marketing  applications,  total  market  penetration  is  rarely  required,  as 
most  healthy  businesses  believe  in  the  value  of  competition  for  the  business  and  its 
customers. 

For  law  enforcement,  on  the  other  hand  -  and  taxation  in  particular  -  it  is 
imperative  to  reach  the  entire  market.  The  unique  challenge  for  government  must  be, 
therefore,  to  obtain  an  optimum  return  for  its  communications  dollar  -  to  support  its 
programs  in  a  constraint  environment. 

This  goal  is  only  attainable  with  a  full  understanding  of  customer  NEEDS.  In 
Revenue’s  application,  this  need  is  usually  for  clearly  understandable  interpretation  of 
complex  taxing  statutes  and  tax  return  forms  that  can  be  easily  completed,  free  from 
error. 


This  understanding  must  also  cover  the  customers’  preferences  for  receiving 
information,  i.e.  the  distribution  channels  to  be  employed.  Where  needs  are  not  met, 
clients  will  phone  for  the  required  information  at  considerably  higher  cost. 

Through  appropriate  targeting  based  on  this  information  it  will  be  possible  to  select 
the  best  communications  mix  for  each  market  segment.  Engaging  the  cheapest  medium, 
or  using  a  ’shotgun  solution’  -  i.e.  covering  too  broad  a  spectrum  with  a  single  solution  - 
rarely  offers  the  best  practice  for  any  given  target  group. 

The  measurement  of  real  cost-effectiveness  can  also  only  occur  in  the  program 
delivery  area  by  evaluating  the  indirect  impact  of  communications  on  program  delivery, 
error  rates  and  enquiries.  This  balanced  approach  makes  internal  coordination  of 
resources  essential. 
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5.  The  Application  of  Feedback,  continued: 

c.  Marketing  Communications  applied  to  Program  Delivery 

Chart  3  below  illustrates  what  it  looks  like  when  marketing  orientation  is  applied  to 
program  delivery: 


Chart  3  -  The  Marketing  Approach  -  With  Feedback 


As  can  be  readily  seen,  this  approach  differs  significantly  from  the  previous  functional 
diagram.  From  the  outset,  the  marketing-oriented  framework  provides  for  feedback  of 
taxpayer  information  needs  and  how  these  might  be  satisfied.  In  addition  to  this  use  of 
research  and  feedback,  the  framework  also  provides  a  series  of  feedback  loops, 
communications  and  service  loops  to  significantly  enhance  the  traditional  functionalized 
approach  to  program  delivery. 

As  some  of  you  already  know,  for  the  past  few  years.  Revenue  has  been  engaged  in 
an  almost  total  review  of  its  business  processes,  a  business  re-engineering  process  known 
to  us  as  ESPRIT.  This  review  placed  strong  emphasis  on  the  values  of  customer  service 
from  the  outset. 

The  approach  recognized  -  consistent  with  marketing  orientation  -  the  inherent 
benefits  of  being  able  to  respond  quickly  to  changes  in  taxpayer  information  needs.  This 
team-based  review  process  faciltates  a  more  efficient  use  of  all  resources  and  effectively 
improves  internal  cooperation. 
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5. 


The  Application  of  Feedback,  continued: 


d.  Customer  Service  and  Revenue 

The  emphasis  on  customer  service  within  the  ESPRIT  re-engineering  process  and  the 
growing  use  of  multi-functional  teams  for  reviewing  business  processes  have  already 
produced  some  interesting  changes  at  Revenue.  In  some  areas,  the  traditional  functional, 
hierarchy-based  thinking  is  already  giving  way  to  a  more  co-operative  approach. 

Using  a  private  sector  customer  service  quality  improvement  model  as  basis,  Chart 
4  below  illustrates  the  time  frames  usually  encountered  by  major  organizations  who  have 
successfully  moved  from  a  "Turf  to  Team"  orientation: 


Customer  Service  Quality  Improvement: 

From  'Turf"  to  Team* 


iseo-w 

'Turf ism”  Communication  Co-operation  Integrated  "Teams" 


*  The  goal  la  customer  Satisfaction 

*  The  focus  of  effort  Is  to  integrate  the  priorities,  objectives  and  compensation  for  sales,  service  and  support  functions 


Chart  4  -  Focusing  is  on  the  Customer  .  .  . 


The  process  of  changing  the  corporate  culture  is  inevitably  a  slow  one,  extending  over 
several  years.  The  benefits  for  Revenue,  Treasury  and  the  Ontario  taxpayer,  however, 
are  expected  to  be  considerable  in  savings  from  operating  costs,  as  well  as  being  able  to 
improve  the  quality  of  customer  service,  both  internally  and  externally. 
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6. 


Doing  "The  Right  Thing  and  getting  It  Right  the  First  Time."  Why  Marketing,  when 

Ih  ere  is  nothing  to  sell? 


A  well-intentioned  business  or  government  department  may  set  out  with  the  best  of  intentions 
of  serving  its  customers  with  a  product  or  service  based  on  internally  perceived,  or  ill-defined 
needs.  Without  knowing  enough  about  the  customers’  expectations,  it  will  be  impossible  to 
provide  a  good  match.  Client  satisfaction  may  result,  but  in  this  instance  it  will  occur  most 
likely  by  accident,  rather  than  by  design. 


a.  The  Risks  of  ’Not  Knowing’ 

Most  businesses  want  to  serve  their  customers  well.  Without  understanding  the  customers’ 
needs  and  expectations  -  the  owners  may  want  to  play  it  safe  and  deliver  well  in  excess 
of  expected  levels.  If  this  service  is  well  beyond  customers’  expectations  or  beyond  their 
comprehension,  a  significant  part  of  this  ’customer  service’  is  wasteful,  since  it  is 
achieves  nothing.  These  ’blind’  excesses  can  actually  harm  the  business. 

To  illustrate  this  point,  consider  a  customer  wanting  to  compare  the  features  of 
appliances,  electronics  or  cars.  When  a  zealous  sales  person  assails  the  customer  with 
unwanted  information,  this  ’service’  will  distract  the  customer  from  his  or  her  intention 
and  can  diminish  the  buyer’s  interest.  Then  there  are  instances  where  well-publicized, 
really  superior  customer  service  may  be  used  to  conceal  shortcomings  in  a  business  or  its 
product,  such  as  a  superior  servicing  bay  supporting  a  car  dealership  selling  ’lemons’. 


b.  Marketing  begins  and  ends  with  the  Customer 

The  key  to  successfully  satisfying  and  exceeding  customers  needs  is  to  know  reasonably 
well  what  these  needs  are.  Once  the  service  or  product  has  been  delivered,  it  is  equally 
desirable  to  learn  how  well  the  customers’  expectations  were  met  and  continue  to  satisfy. 
The  relationship  between  need  and  fulfilment  then  becomes  part  of  an  ongoing  series  of 
cycles  involving  planning,  delivery,  measurement  and  checking,  improvement,  each  of 
which  begins  and  ends  with  the  customer. 


c.  The  importance  of  research  -  Why  measure  at  all? 

If  a  business  wishes  to  know  how  well  it  is  performing  in  satisfying  its  customers’  needs 
and  wants,  it  is  essential  to  establish  a  basis  for  measuring  this  performance.  A  good 
business  will  also  want  to  know  why  customers  are  supporting  it,  how  it  is  performing 
relative  to  its  competitors  and  why  their  clients  prefer  them,  as  well  as  the  strengths  and 
weaknesses  of  either  as  perceived  by  its  customers. 

In  any  competitive  situation,  this  information  is  critical  for  the  business  to  improve 
its  product  or  services,  keep  abreast  of  market  changes  and  operate  efficiently.  There  are 
several  ways  for  achieving  these  objectives,  as  will  be  discussed  later. 
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7. 


Customer  Service:  "The  Moment  of  Truth"  -  What  is  there  to  measure? 


When  Jan  Carlzon  saved  Scandinavian  Airlines  from  heavy  and  growing  losses  in  1979/80, 
among  many  other  issues  he  focused  on  improving  the  delivery  of  customer  service.  For  this 
he  worked  on  the  thousands  of  ’Moments  of  Truth,’  those  points  in  time  when  employees  come 
face-to-face  with  the  customer. 


a.  The  "Moment  of  Truth" 

Much  has  been  written  about  the  ’moment  of  truth’,  illustrated  in  Chart  5  below. 
Ultimately,  the  words  count  for  very  little.  The  real  issue  is  one  of  communicating 
between  two  people:  the  employee  and  the  customer.  When  employee  and  customer  are 
brought  together  as  total  strangers  in  the  context  of  ’transacting  a  service,’  they  look  at 
the  same  needs,  attitudes,  beliefs,  feelings,  values  and  other  inputs,  but  from  opposite 
directions. 


Customer  Service:  'The  Moment  of  Truth" 

Customer  Inputs:  Employee  Inputs: 


Chart  5  -  When  Employee  and  Customer  meet  . .  . 


To  respond  to  each  customer’s  perceived  needs  and  values,  and  interpret  these  correctly 
every  time,  requires  considerable  training,  public  relations  skill  and  empathy  with 
customers  or  taxpayers.  While  a  well-trained  staff  will  excel  in  providing  superior 
customer  service  under  widely  varying  conditions,  there  is  always  a  risk  of  disharmony. 

In  practice,  this  disharmony  or  dissension  can  lead  to  customer  dissatisfaction.  As 
another  form  of  service  "gap",  it  can  also  be  identified,  measured,  quantified  and 
corrected,  through  training  and  managing  the  customer  service  relationship. 
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7.  Customer  Service  Measurables.  continued: 

b.  Managing  and  exceeding  Customers’  Expectations 


"What  do  the  customers  really  want?"  and  "What  are  their  expectations?"  are  questions 
facing  any  business  manager.  To  grasp  the  answers  to  these  questions  we  must  first 
understand  the  elements  that  distinguish  ’superior  customer  service’  from  ’customer 
satisfaction’  (Chart  6): 


Customer  Service  Quality: 

Managing  and  Exceeding  Customers'  Expectations 


fitm 

Ltrtto-i 


Outcome  Process 

Dimension  Dimension 


Zone  o»  Totomnce 


Source  TAarkotjna  Services0.  Berry  A  Pareeu  reman.  1991 


Chart  6  -  Managing  and  exceeding  Expectations 


Recent  research  by  Berry,  Zeithaml  &  Parasuraman  in  the  United  States  has  shown  that 
customers’  service  expectations  exist  at  two  different  levels.  As  illustrated  here,  the 
’Desired  Service’  is  the  level  of  service  promised.  Where  the  business  fails  to  promote  its 
services,  or  neglects  important  detail,  the  customer  usually  assumes  a  desired  level  of 
service  based  on  past  experience  -  or  less  desirable  -  on  assumptions  or  those  of  one’s 
competitors. 

Most  customers  are  reasonable  and  do  not  expect  the  ultimate  in  service  on  every 
occasion.  The  resulting  ’Adequate  Service’  level  thus  makes  concessions  in  the  delivery 
process.  Both  the  desired  and  adequate  service  levels  vary  for  individual  service 
components  and  among  clients.  The  ’Zone  of  Tolerance’  makes  up  the  space  between 
these  two  levels. 
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7.  Customer  Service  Measurables.  continued: 

b.  Managing  Customers’  Expectations,  continued: 

For  the  government  application,  this  tolerance  range  is  most  significantly  affected  by  the 
’reliability  and  responsiveness  of  the  service,’  which  customers  rank  most  highly  and 
shown  here  as  the  ’outcome  dimension’  for  the  transaction. 

Placed  somewhat  lower  among  customers’  priorities  are  the  dimensions  concerned 
with  the  delivery  process  itself  -  i.e.,  HOW  the  service  is  delivered,  such  as  "assurance" 
(the  knowledge  and  courtesy  of  employees),  "emphathy"  (level  of  caring  and  individual 
attention)  and  the  "tangible  parts"  of  the  service." 

The  priorities  and  customer  satisfaction  levels  must  be  measured,  analyzed  and 
tracked  in  some  detail  for  each  component  making  up  the  service  culminating  in  the 
"Moment  of  Truth"  -  consistently  and  continuously.  Any  satisfaction  measurement  must 
involve  the  customer  as  the  ultimate  judge  since  this  aspect  relates  directly  to  the 
customers’  original  needs  and  expectations. 

c.  Establishing  Customer  Satisfaction  through  Managing  and  Exceeding  their  Expectations 

Once  the  service  parameters  and  priorities  are  known  from  research  involving  the 
customer,  it  becomes  relatively  easy  to  define  and  specify  the  service  components 
required  to  satisfy  and  exceed  the  customers’  expectations. 

Usually  customer  service  is  comprised  of  many  service  elements  and  services 
support  from  colleagues  and  suppliers,  in  addition  to  the  transaction  at  the  ’Moment  of 
Truth.’  For  optimum  results,  it  is  essential  to  orchestrate  all  these  individual  components, 
leaving  nothing  to  chance. 

After  service  parameters  have  been  clearly  defined,  it  is  consistent  with  good 
business  practice  to  define  the  service  to  be  delivered  at  somewhat  higher  levels  than  the 
’desired  service,’  but  never  below  the  ’adequate  service’  level. 

Where  these  parameters  are  unknown  due  to  lack  of  feedback,  it  is  usually  tempting 
to  ’play  it  safe’  and  deliver  a  level  of  customer  service  well  beyond  what  is  expected  *  and 
appreciated.  Based  on  internal  perceptions  of  need  alone,  this  service  may  be  safe,  but 
it  also  risks  becoming  very  wasteful. 

d.  The  measurable  ’Gaps’ 

In  that  the  gaps  between  customer  needs,  desired  service  and  customer  satisfaction  with 
the  service  delivered  are  all  in  their  respective  ways  measurable,  these  gaps  -  and  thus 
customer  service  delivery  -  can  also  be  managed. 
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8. 


Customer  Service  Quality  and  Gaps  in  Service  Delivery 


The  process  of  identifying  performance  gaps  has  been  used  in  business  for  decades,  most 
notably  for  measuring  and  predicting  manufacturing  and  sales  progress.  The  model’s 
application  for  measuring  gaps  in  perception  of  service  quality  is,  however,  relatively  new, 
dating  back  to  the  mid-1970s. 

The  customer  service  ’Gap  Model’  for  determining  customer  service  quality,  as  used  for 
the  recent  CSTF  Survey,  has  been  progressively  developed  for  application  to  services  marketing 
over  a  period  of  almost  ten  years  and  it  continues  to  evolve. 


Customer  Service: 
Conceptual  Model  of  Service  Quality 


Basad  on  "Dolrvemg  Quality  Sarvrca".  Zethawl.  Parasurman  and  Barry ,  1990 


Chart  7  -  The  Customer  Service  ’Gap’  Model 


The  above  Chart  clearly  relates  the  various  areas  in  the  customer  service  delivery  chain, 
illustrating  where  differences  in  perceived  value  or  quality  can  occur.  Five  in  number,  these 
’gaps’  all  impact  on  service  quality,  and  ultimately  on  customer  satisfaction.  In  practice,  each 
must  be  identified  and  measured  separately: 

a.  The  most  important  of  the  five  gaps  measures  the  difference  between  the  public’s 
’expected  level  of  service’  and  the  ’perception  of  the  service  delivered,’  shown  on  the  left- 
hand  side  of  the  chart.  This  difference  -  Gap  5  -  usually  surfaces  during  service  delivery, 
and  is  first  detected  by  the  customer  at  the  ’Moment  of  Truth.’  It  is  the  cumulative  effect 
of  all  shortcomings  encountered  before  and  during  service  delivery. 
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8. 


Customer  Service  Quality  and  Gaos,  continued: 


b.  The  second  perception  gap  [Gap  1]  is  usually  due  to  lack  of  proper  appreciation  of 
customers’  ’service  expectations’  by  senior  management,  often  caused  through  insufficient 
market  research  or  feedback.  To  close  this  gap,  senior  management  must  learn  to  listen 

to,  and  hear  their  customers. 

c.  The  third  gap  in  perception  [Gap  2]  is  largely  due  to  lack  of  a  clear  commitment  by  senior 
management  to  their  customers’  expectations  for  service  quality.  This  deficiency 
culminates  in  the  ’service  quality  design  gap.’  Quality  service  delivery  requires  leadership 
and  commitment  from  top  management,  without  which  -  according  to  the  experts  -  quality 
service  or  service  quality  improvement  simply  cannot  happen. 

d.  Even  where  senior  management  is  aware  of  customers’  needs  for  quality  and  sets 
appropriate  specifications,  delivery  performance  can  still  suffer.  This  occurs  when  the 
need  for  quality  is  not  clearly  communicated  to  staff,  or  when  -  due  to  lack  of  training 
or  proper  motivation  -  service  delivery  falls  short  of  the  designed  service  specifications 

[Gap  3].  The  solution  here  calls  for  strong  internal  communications  between  functional 
units,  a  total  involvement,  on-going  training  and  empowerment  of  staff. 

e.  The  last  perception  gap  [Gap  4]  is  caused  when  promises  -  or  in  their  absence,  perceived 
expectations  -  do  not  match  service  delivery.  Where  the  marketing  of  services  is  involved, 
there  usually  is  a  strong  risk  of  over-promising,  or  excessive  expectations  among 
customers.  This  gap  is  invariably  caused  through  inefficient  external  communications. 
It  can,  therefore,  also  be  minimized  through  increased  two-way  communications 
efficiencies,  involving  feedback  and  ’educating  the  customer  in  what  to  expect’. 

From  the  preceding  material,  the  need  for  marketing  research  and  feedback  is  self  evident.  The 
following  sections  will  review  the  options  and  methods  available  to  a  senior  manager  in  the 
Ontario  Government. 
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9. 


Trial  and  Error  versus  Marketing  Research  -  How  can  we  measure? 


In  practice,  there  are  two  basic  ways  to  determine  the  customers’  or  taxpayers’  needs,  wants  and 
priorities:  Through  Trial  &  Error  and  through  Market  Research. 


a.  Trial  &  Error 

Trial  and  error  involves  simply  introducing  the  program  or  service  and  seeing  how  the 
public  reacts.  Used  on  a  small  scale  by  small  businesses,  this  approach  may  be  cheaper 
and  easier  than  research.  A  simple  way  for  a  local  store  to  see  if  a  new  product  will  sell 
is  to  add  it  to  the  shelf  and  watch  what  happens. 


b.  Market  Research 

For  a  larger  business,  however,  the  impact  of  high  volumes  can  make  this  simple 
approach  very  costly  and  risky.  Today,  market  research  provides  a  tool  for  most  large 
businesses  dealing  in  goods  and  services  to  reduce  their  risk  by  anticipating  the  wants 
and  needs  of  their  markets. 


c.  The  Need  for  Market  Research  or  Feedback  in  Government 

With  the  large  volumes  of  processes  involved  in  serving  large  populations  of  government 
customers  or  taxpayers,  even  small  errors  and  their  remedy  can  result  in  considerable 
extra  work  and  cost  for  government.  For  instance,  a  minor  error  on  a  form  completed  by 
a  hundred  thousand  taxpayers  that  takes  a  mere  minute  to  correct  requires  an  additional 
$24,000  in  resources! 
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10.  The  Tools.  Methods  and  Cost/Benefits  of  Marketing  Research 


The  approach  to  obtaining  meaningful  feedback  is  a  little  more  complicated  than  merely 
composing  a  few  simple  questions  and  placing  these  before  the  customer.  Since  market  research 
is  usually  conducted  with  limited  budgets  or  resources,  it  is  essential  that  these  be  employed 
for  optimum  effect. 


Customer  Satisfaction: 

Needs  Analysis  and  Performance  Measurement 


i  (rarely  used]; 


*  Strmngttm,  Wmmknmmmam,  Opportunist**  4  Thrmmta;  Identity  Obfmcttvam  and  PrksrtUom 


Chart  8  -  The  Feedback  Measurement  Processes 


As  shown  in  Chart  8  above,  the  first  question  to  be  addressed  must  focus  on  "What  ACTION 
is  intended?"  or  "What  will  the  research  be  used  for?"  This  need  is  usually  filled  through  a 
"Situation  Analysis." 

a.  Situation  Analysis 

Once  the  need  for  action  has  been  agreed  in  principle,  the  next  step  is  to  conduct  a 
situation  analysis.  The  purpose  of  the  situation  analysis  in  a  competitive  environment 
is  to  determine  all  forces  likely  to  (1)  support  and  (2)  oppose  the  project.  This  analysis 
culminates  with  a  definition  of  the  relative  Strengths,  Weaknesses,  the  Opportunities  and 
Threats  (SWOT  Analysis).  Priorities  and  Objectives  follow  logically  from  this  process. 
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10. 


The  Tools.  Methods,  etc.,  continued: 


b.  (1)  Customer  Satisfaction  Measurement 

As  a  general  rule,  it  is  unwise  to  conduct  surveys  specifically  to  obtain  feedback 
on  customer  satisfaction  levels.  This  approach  is  usually  interpreted  as  primarily 
self-serving  among  customers  or  taxpayers,  and  usually  results  in  lower  response 
rates. 


Experience  has  shown  that  higher  response  rates  -  and  increased  levels  of 
objectivity  in  answers  -  result  when  customer  satisfaction  measurement  questions 
are  added  in  small  measure  to  routine  marketing  research  conducted  at  regular 
intervals.  This  preference  does,  however,  not  rule  out  the  option  of  conducting 
surveys  exclusively  devoted  to  customer  satisfaction  levels. 


Questionnaire  Construction  -  Maior  Cateaories 

i 

1 

1. 

2. 

Responsiveness  of  Service 

) 

3. 

Access  to  Service 

) 

4. 

Timeliness  of  Service 

) 

Employ 

5. 

Speed  of  Transaction 

) 

subsidiary 

6. 

Staff  Attitudes,  Helpfulness 

) 

Questions 

7. 

Completeness  of  Service 

) 

tor  Details 

8. 

Professionalism  of  Service 

) 

9. 

Satisfaction  with  Product  or  Service  Quality 

) 

10. 

Overall  Satisfaction  with  Service 

Chart  9  -  Customer  Satisfaction  Measurement 


Regardless 
which 
option  is 
used,  over  a 
period  of 
time  a  num- 
b  e  r  of 
major  ser¬ 
vice  cat- 
e  g  o  r  i  e  s 
must  be 
covered. 
These  cat¬ 
egories  to 
be  covered 
in  feedback 
vary  from 
one  busi- 
n  e  s  s  to 
another. 


This  need  applies  equally  for  government  ministries  or  departments  wishing  to 
measure  their  client  satisfaction  levels.  Figure  9  above  provides  a  sample  of  the 
major  categories  which  impact  on  customer  satisfaction  levels.  Several  subsidiary 
questions  may  be  required  to  probe  for  essential  secondary  detail.  This  stratified 
approach  facilitates  both  the  priorization  of  desired  areas  for  improvements,  and 
enables  management  to  decide  on  remedies  that  produce  the  optimum  benefit. 
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10.  The  Tools.  Methods,  etc.,  continued: 


c. 


(2)  Recognizing  Customer  Service  Deficiencies 

With  many  businesses,  over  40%  of  clients  become  dissatisfied  for  reasons  that  have 
little  to  do  with  the  product  itself.  Often  the  shortfall  in  customer  service  rests  in 
totally  unrelated,  secondary  areas  of  the  business,  such  as  "easy  and  safe  access"  for 
cars  or  pedestrian  traffic,  the  "ability  to  park  conveniently,"  or  the  "hours  when  the 
business  is  open  to  serve  its  customers."  This  point  can  be  illustrated  with  a 
composite  practical  example  drawn  from  travel/tourism  and  financial  services 
operations. 

Most  businesses 
would  be  delighted 
to  experience  the 
same  customer  ser¬ 
vice  levels  above 
80%  in  important 
areas,  e.g.  ’friendly, 
courteous,  know- 
led  gable  and  experi¬ 
enced  staff’,  'helpful 
staff,  offering  al¬ 
ternate  choices  in 
response  to  their 
customers’  needs.’ 


Sadly,  as 
shown  in  Chart  10 
at  right,  the 
neglected  service 
elements  left  a  size¬ 
able  gap  in  other 
areas  of  importance 
to  their  customers 
and  many  left  for 
competitors  without 
first  complaining. 


Review  of  Existing  Data 


Most  government  minis¬ 
tries  already  hold  vast 
amounts  of  data  that  is 
often  not  entirely  apprec¬ 
iated  nor  fully  used.  As  a 
general  rule,  it  is  more 
efficient  -  and  quicker  -  to  use  internal  sources  for  information  where  ever  these  can  be 
used.  For  satisfaction  measurement,  input  from  staff  is  both  invaluable  and  essential. 


Customer  Service  &  The  Need  for  Balance 

Tourism  and  Banking  Sectors 


Chart  10  -  Secondary  Customer  Service  Gaps 


21 


10.  The  Tools.  Methods,  etc.,  continued: 


c.  Review  of  Existing  Data,  continued: 

Where  internal  data  is  not  available  or  unsuited,  data  may  have  to  be  acquired  from 
external  sources.  If  similar  needs  have  been  addressed  elsewhere,  the  required  data  may 
already  be  available  in  a  useable  format,  thus  saving  valuable  time  and  effort.  Only 
when  these  avenues  have  failed  to  produce  the  required  data,  should  we  consider 
acquiring  new  feedback.  For  customer  satisfaction  measurement,  it  is  almost  always 
necessary  to  acquire  fresh  feedback. 

d.  Methods  for  obtaining  Data 

For  consulting  the  public,  there  are  a  good  number  of  methods  available  for  acquiring 
feedback.  The  data  gathering  methods  vary,  from  major  public  hearings,  through  focus 
groups  or  group  discussions,  face-to-face  interviews,  telephone  interviews,  mail  surveys, 
to  simple  observation.  As  of  these  methods  have  their  own  merits  and  limitations,  their 
suitability  varies  from  project  to  project. 

e.  Focus  Groups  versus  Quantitative  Research 

Regardless  which  marketing  research  or  feedback  method  is  employed,  the  greatest 
hurdle  to  overcome  is  "How  to  identify  possible  sources  of  bias?"  and  "what  methods  to 
employ  for  minimizing  any  bias  from  the  outset?"  One  form  of  bias  evolves  around  the 
executive  issue  of:  Focus  Group  or  Quantitative  Research? 

(1)  Focus  Group  Interviews.  Although  not  the  only  method  of  qualitative  research, 
focus  groups  are  very  good  for  some  marketing  research  applications,  in  a  very 
limited  way.  They  are  ideally  suited  when  a  researcher  knows  too  little  about  a 
market,  an  industry  or  issue,  to  design  a  good  questionnaire  for  quantitative 
research.  In  practice,  focus  groups  are  good  for  ’learning,’  but  not  for  testing;  they 
are  ideal  for  observing  ’group  dynamics’,  rather  than  individual  thinking  or 
behaviour,  and  well  suited  for  pre-testing  of  questionnaires  or  advertising  artwork 
-  but  for  little  else. 

Focus  group  findings  are  descriptive,  subjective,  exploratory  and  approxi¬ 
mate.  Owing  to  the  groups’  small  size  -  averaging  8  to  10  members  -  and  the  absence 
of  sampling,  results  cannot  be  projected  and  for  controversial  issues  their  results 
can  also  be  misleading.  Owing  to  these  limitations,  the  practical  benefit  from  focus 
groups  is  very  limited. 

(2)  The  Need  for  Quantitative  research  involves  conducting  market  research  among  a 
representative  sample  of  the  population.  This  requires  some  understanding  of  the 
market  to  begin,  including  the  preferred  "language"  or  jargon,  basic  attitudes  and 
lifestyle  habits.  Often  this  requires  considerable  research  front-up.  Research 
results  are  projectable  within  given  limits  of  accuracy,  and  the  findings  are  usually 
definitive,  objective,  precise  and  usable  for  diagnostic  purposes.  Quantitative 
research  may  employ,  face-to-face  or  telephone  interviews,  or  mail  surveys. 

The  results  of  quantitative  research  may  take  more  time  to  obtain,  but  the 
results  are  projectable  to  the  entire  market.  As  such,  they  will  support  management 
decisions  more  effectively,  more  accurately,  than  focus  groups. 
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10. 


The  Tools.  Methods,  etc.,  continued: 


f.  Quantitative  Research  versus  Focus  Group:  The  relative  costs 

The  current  (1992)  average  cost  for  a  single  focus  group  amounts  to  between  $4,000  and 
$5,000.  Chart  11  below  illustrates  the  relative  cost  for  employing  focus  groups  and 
quantitative  research  methods,  from  a  ’optimum  beneficial  use’  of  focus  groups  in 
isolation  for  identifying  issues,  to  a  ’supporting  role’  for  pre-testing  applications,  through 
various  practical  combinations  of  focus  groups  and  quantitative  research.  In  most 
practical  business  applications,  smaller  surveys  conducted  frequently  are  more  efficient, 
they  are  easier  to  manage  and  the  results  are  more  likely  to  be  applied. 


Marketing  Research:  Relative  Costs 
Focus  Groups  versus  Quantitative  Feedback 


Average  Total  Coats: 


$30,000 

to 

$60,000 

$70,000 

to 

$130,000 

$40,000 

to 

$80,000 

$20,000 

to 

$50,000 

Revenue: 

Average 

<$6,000 

Methodology; 

Focus  Group 

Focus  Group 

Average  for 

Small  Scale 

Small  Scale 

” Testing " 

A  Quantitative 

Quantitative  alone 

Quantitative 

Quantitative 

Chart  11  -  Focus  Group  versus  Quantitative  Market  Research 


Conversely,  very  large,  high-profile  surveys  conducted  infrequently,  usually  produce  an 
excess  of  information  that  is  too  difficult  to  comprehend  or  absorb  by  most  managers, 
and  is  thus  less  likely  to  be  applied.  "Small  and  often"  provides  the  best  and  most 
economical  results.  The  Ministry  of  Revenue’s  experience,  based  on  more  frequent,  very 
low  profile,  smaller  surveys  has  resulted  in  average  costs  and  visibility  well  below  the 
industry  average. 
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10.  The  Tools.  Methods,  etc.,  continued: 


g.  Questionnaire  Construction 

Reverting  briefly  to  the  previous  Chart  8,  it  must  be  appreciated  that  designing  a  good 
questionnaire  cannot  occur  in  isolation.  The  design  must  consider  the  desired  actionable 
intent,  commence  with  a  situation  analysis  leading  to  objectives,  priorities,  and  an  action 
plan,  all  usually  documented  in  "Terms  of  Reference".  —  The  design  of  the  questionnaire 
must  also  consider  the  analytical  processes  to  be  used  later,  which  in  turn  will  impact  on 
the  structure  of  questions.  Bias  issues  must  be  addressed  throughout  this  process. 

(1)  Asking  the  right  People 

When  developing  feedback  for  specific  aspects  of  program  delivery,  such  as  forms 
testing,  understanding  of  instructions,  customer  attitudes,  measuring  customer 
satisfaction  levels,  it  is  desirable  to  limit  responses  to  people  who  are  either  directly 
affected  or  have  had  experience  with  the  service  under  review.  Planning  must 
provide  for  the  exclusion  of  all  unqualified  responses  from  the  analysis  process. 

For  instance,  when  asking  customers  about  their  experience  with  enquiries 
handling,  a  second  question  must  determine  whether  they  actually  used  this  service 
during  a  specified  time  frame.  This  approach  is  particularly  important  for  services 
such  as  government,  the  post  office,  airlines,  customs,  banking,  hotels,  where  far 
more  people  have  been  exposed  to  the  experiences  and  ’horror  stories’  of  others  and 
the  risk  is  high  that  the  answers  given  may  not  be  their  personal  experience  or  these 
may  relate  to  an  earlier  time  period. 

(2)  Asking  the  right  Questions 

Many  books  have  been  written  about  question  design,  and  the  use  of  scales.  Since 
this  material  is  readily  available,  it  is  here  not  intended  to  cover  this  topic  indetail. 
As  a  general  rule,  simplicity  works  best:  Two  or  three,  very  direct  questions  usually 
combine  to  yield  more  accurate  results  than  one  very  complex  question.  It  is  worth 
noting  that  cross-tabulation  of  data  in  a  personal  computer  now  facilitates  this 
approach. 

The  "obvious"  question  often  plays  a  significant  role  in  this  cross-analysis 
process  and  should  not  be  discarded,  simply  because  of  erroneous  beliefs  like  "we 
don’t  need  to  know  this  (in  isolation),"  or  that  "we  already  have  access  to  that 
information."  Especially  when  identifying  customer  needs,  it  is  essential  to 
structure  the  questions  to  solicit  a  number  of  related  answers.  Failing  to  do  this 
would  still  provide  misleading  answers  and  lead  to  unwarranted  investment  to  cater 
to  a  service  need  that  does  not  exist. 

For  instance,  asking  the  public’s  preference  for  their  next  sun  vacation  may 
produce  answers  from  well  over  85%  who  indicate  their  expensive  "dreams",  like 
"Hawaii"  or  lengthy  "Cruises"  -  which  are  actually  bought  by  less  than  2%  of  the 
market.  As  a  follow,  it  is  thus  essential  to  probe  further,  for  "affordability"  within 
given  "time  frames",  in  order  to  identify  the  respondents’  REAL  NEEDS  AND 
WANTS,  rather  than  wishful  thinking.  These  needs  can  then  be  further  cross- 
referenced  with  demographic  or  lifestyle  data  to  verify  their  sincerity. 
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The  Tools.  Methods,  etc.,  continued: 


(3)  Objective  versus  subjective  Questions 

Objective,  or  close-ended,  questions  offer  the  respondent  a  range  of  presumed 
responses.  These  questions  are  popular,  since  they  are  easy  to  analyze  and  cross- 
tabulate  with  others  by  using  an  appropriate  software  for  personal  computers. 
Various  methods  of  scaling  are  available  for  measuring  different  shades  of  opinion 
or  priorities.  These  include  closed-ended  and  open-ended,  or  subjective  questions: 

(a)  Closed-ended  Questions: 

•  Simple  Questions  requiring  "YES"  or  " NO "  answers:  to  prevent  ambiguity, 
a  third  reply  category  "Don’t  know"  or  "Not  applicable"  is  often  adviseable; 

•  An  uneven  number  of  graded  answers  in  response  to  a  given  statement: 

covering  for  instance,  from  "Strongly  Agree"  through  "Agree”,  "Neither 
Agree / Nor  Disagree",  "Disagree"  to  "Strongly  Disagree ",  with  variations 
for  time,  commitment,  importance,  etc.,  (Likert  scales); 

o  Selection  of  one  or  more  responses  from  a  given  list:  respondents  are 
asked  to  select  or  rank  their  preference  from  a  pre-selected  list  of  prob¬ 
able  options  which  should  include  provision  for  "Others,  please  specify", 
to  ensure  completeness; 

e  Rated  Replies:  respondents  may  be  asked  to  rate  answers  on  a  scale  of  1 
to  5,  7  or  10;  again,  there  are  occasions  when  it  adviseable  to  include  space 
for  "don’t  know"  or  "not  applicable”  replies. 

(b)  Open-ended,  or  subjective,  questions 

Open-ended  or  subjective  questions  allow  the  respondent  a  free  range  for  their 
replies.  Considered  to  be  ’less  confining’  by  non-researchers,  answers  to  this  style 
of  question  tend  to  provide  large  amounts  of  unfocused,  often  trivial  information. 
The  analysis  requires  considerable  additional  work.  Applied  with  a  clear  focus  and 
in  moderation,  however,  these  questions  are  indispensable  f or  in-depth  analysis,  for 
reacting  to  displayed  material,  or  for  augmenting  objective  data  obtained  from 
close-ended  questions. 

(4)  Cost  Factors 

The  cost  of  processing  open-ended  questions  is  considerably  higher,  based  on  three 
to  four-times  the  amount  of  time  and  effort  needed  for  their  analysis  and  tabula¬ 
tion.  Business  priorities  dictate  the  need  for  balance. 

The  relative  cost  for  variouscombinations  of  closed  and  open-ended  questions 
used  in  a  questionnaire  with  30  questions  varies  considerably.  This  difference  is 
illustrated  in  Chart  12  on  the  next  page.  The  difference  in  cost  is  entirely  due  to 
the  extra  labour  component  in  processing  open-ended  questions,  compared  to  an  $ 
6,000  average  cost  achieved  by  Revenue,  with  only  a  modest  use  of  open-ended 
questions  used  to  amplify  specific  issues. 


25 


10.  The  Tools.  Methods,  etc.,  continued: 


(4)  Cost  Factors,  illustrated: 


*100jB0»- 


$80400- 


$60j£SB»- 


&S0.M©- 


*20,080- 


Customer  Satisfaction  Measurement: 
Balancing  the  Cost  of  Marketing  Research 


D 


Ok 


Mix  consisting  of  Closed  and  Open-ended  Questions 


Chart  12  -  Relative  Costs:  Open  and  Closed  Questions 


(5)  Keep  Questions  Simple  -  Use  Cross-Tabulation 

The  development  of  computer  software  for  marketing  research  and  feedback  has 
made  considerable  strides  in  recent  years.  This  development  facilitates  the  use  of 
more  direct,  very  simple  question  subsets  which  can  then  be  analyzed  through 
computer  cross-tabulation,  to  provide  analysis  results  of  far  greater  depth  and 
insight  than  previously  possible. 

Generally  speaking,  broad  based,  single  statements  of  questions  containing 
several  sub-questions  joined  by  ’and’  or  ’or’  should  be  avoided,  since  the  resulting 
answers  will  also  be  ambiguous.  This  type  of  question  causes  confusion,  likely  to 
result  in  refusal  to  cooperate  further.  These  questions  should  be  rephrased  into 
several,  simple,  questions. 

(6)  Major  Question  Categories 

For  customer  satisfaction  measurement,  it  is  important  to  identify  and  understand 
the  importance  to  the  customer  of  each  component  of  the  service  offered.  This 
requirement  is  not  dissimilar  from  evaluating  a  tangible  product,  which  may  be 
rejected  for  relatively  trivial  reasons.  When  the  customer  is  sufficiently  dissat¬ 
isfied  to  seek  out  alternatives  elsewhere,  even  the  trivial  becomes  important! 
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10.  The  Tools.  Methods,  etc.,  continued: 


h.  On  Survey  Sampling:  How  much  is  "Enough?" 

When  faced  with  a  need  for  feedback,  one  of  the  first  questions  often  asked  is:  "Wouldn’t 
it  be  better  to  carry  out  a  complete  count  rather  than  take  a  sample?"  or  "What  is  the 
minimum  percentage  required  to  produce  reliable  results?  Essentially,  there  are  two 
kinds  of  surveys:  Census  surveys  and  Sample  surveys. 


(1)  Major  Types  of  Survey 

According  to  Statistics  Canada,  these  may  be  defined  as  follows: 

•  A  Census  Survey  refers  to  the  collection  of  information  about  characteristics 
of  interest  from  all  units  in  the  population.  In  practice,  this  solution  is  very 
costly,  it  is  time  consuming  and  therefore  not  necessarily  very  accurate. 

0  A  Sample  Survey  refers  to  the  collection  of  information  about  characteristics 
of  interest  from  only  a  part  of  the  population. 

The  main  objective  of  marketing  research  is  to  obtain  reliable  information  at  a 
reasonable  cost  quickly  without  alerting  competitors.  Absolute  accuracy  is  rarely 
essential  in  a  dynamic  environment,  since  the  base  will  begin  to  change  once  action 
is  taken  to  change  direction.  Too  often  valuable  time  is  wasted  in  the  pursuit  of 
meaningless  accuracy,  and  valuable  opportunities  are  lost  or  problems  addressed  too 
late.  How  much  information  is  really  needed  to  produce  reliable  results,  and  "how 
much  is  enough?" 


(2)  Accuracy  of  Random  Sampling 

The  accuracy  of  survey  results  based  on  a  random  sample  depends  largely  on  the 
size  of  the  sample,  and  very  little  on  the  size  of  the  population.  Thus,  a  sample  of 
750  will  provide  as  accurate  a  picture  of  the  characteristics  of  a  large  population, 
such  as  all  of  Ontario,  as  of  a  smaller  population  like  Peterborough  or  Windsor. 
The  importance  of  the  sample  size  grows  with  the  detail  desired  from  the  data.  If, 
for  instance,  it  is  desired  to  analyze  data  in  greater  detail,  according  to  sub 
characteristics  such  as  gender,  the  need  for  a  larger  sample  grows  accordingly. 


(3)  Survey  Response  Rates 

Industry  Standards.  Refusal  rates  for  market  research  projects  are  usually  high. 
This  situation  causes  bias  problems,  regardless  which  method  is  selected  for 
gathering  feedback  data.  Both  independent  research  and  experience  have  shown 
that  on  average  50%  of  contacts  will  respond  to  telephone  surveys,  45%  to  personal 
interviews  and  barely  7%  to  8%  to  mail  surveys.  -  While  response  rates  for 
telephone  and  personal  interviews  have  declined  significantly  (from  72%  and  54%, 
respectively,  for  ’phone  and  personal  interviews)  in  recent  years,  due  to  lifestyle 
changes,  response  rates  for  mail  surveys  have  remained  constant. 
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10.  The  Tools.  Methods,  etc.,  continued: 


(3)  Survey  Response  Rates,  continued: 

Ministry  of  Revenue  Experience.  Throughout  the  past  eight  years.  Revenue  has 
experienced  an  average  34%  response  rate  for  all  methods  of  feedback  on  the  first 
contact,  regardless  of  the  method  employed.  In  some  instances,  with  a  personalised 
approach  and  subsequent  follow-up,  it  was  possible  to  raise  the  response  rate  to  over 
55%.  Revenue’s  34%  average  response  rate  for  mail  surveys  is  exceptional. 

(4)  Survey  Accuracy  and  Sample  Size 

Generally,  the  accuracy  of  survey  results  increases  as  the  sample  size  increases,  but 
never  by  as  much  as  the  increase  in  sample  size.  This  characteristic  is  clearly 
illustrated  in  Chart  13  below: 


Customer  Satisfaction:  Marketing  Research 
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*  Read:  "There  la  a  95%  probability  that  the  true  answer  tails 
between  70 %  (75%  ■  5%)  and  80%  (75%  +  5%)." 


Chart  13  -  Survey  Margins  of  Error 


For  a  given  response  to  a  question  of  75%  from  a  sample  of  300  completed 
questionnaires,  the  accuracy  is  within  plus  or  minus  5%  -  95%  of  the  time.  This 
means  that  if  this  result  were  applied  to  the  entire  population,  the  true  answers  can 
be  expected  to  fall  between  70%  and  80%. 
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10.  The  Tools.  Methods,  etc.,  continued: 


(4)  Survey  Accuracy  and  Sample  Size,  continued: 

If  the  sample  size  is  doubled  to  600  for  the  same  level  of  response,  the  accuracy 
would  improve  accordingly,  but  only  to  within  plus  or  minus  3.5%  -  not  2.5%  as 
might  have  been  expected.  To  obtain  accuracy  within  2.5%  would  require  a  sample 
four  times  as  large  as  the  original,  i.e.  1,200  -  at  a  corresponding  increase  in  cost! 
Similarly,  the  chart  also  illustrates  how  accuracy  increases  as  answers  increase 
above  50%:  A  95%  reply  presents  a  more  accurate  result  than  another  close  to  50%. 
The  corresponding  impact  of  survey  costs  are  self-evident 


(5)  The  Impact  of  Response  Rates  on  Sample  Size 

Once  the  applicable  response  rates  are  known  from  experience,  it  is  relatively  easy 
to  increase  the  size  of  the  sample  frame  appropriately,to  ensure  that  the  required 
minimum  of  completed  interviews  or  questionnaires  are  returned.  Revenue’s 
success  rate  in  this  respect  has  been  within  2%. 


(6)  Practical  Measures  for  raising  Response  Rates 

The  normal  response  rate  for  mail  surveys  can  be  increased  considerably  by 
following  a  number  of  important  steps: 

®  Personalize  the  covering  letter  or  forms  used; 

®  Provide  prepaid  envelopes  for  return  of  questionnaire  (use  of  postage 
stamps,  rather  than  machine  printed  reply-paid  envelopes,  can  increase 
normal  base  response  rates  by  up  to  7%); 

«  Confine  questions  to  research  topic,  without  including  ’frivolous’  or 
self-serving  questions; 

9  Employ  ’user  friendly’,  simple  questions,  which  are  easy  to  understand 
and  follow; 

»  Limit  the  number  of  open-ended  questions; 

0  Use  short  questionnaire,  not  exceeding  20  questions  or  3  to  4  pages; 

9  Avoid  small  print  and  lengthy  text  messages; 

9  Avoid  ’computerized  look’  design; 

9  Always  pre-test  questionnaires  before  finalizing. 

Performance  Measurement  and  Service  Quality  Improvements 

It  is  impossible  to  over-emphasize  the  need  for  using  the  most  reliable  and  accurate  data 
possible,  whether  it  involves  feedback  neded  for  quality  improvement  projects,  for 
performance  evaluation,  trend  analysis  and  tracking,  or  for  routine  business  operations, 
e.g.  M.I.S.,  applications.  Some  of  the  more  important  considerations  will  be  covered  in  the 
following  sections. 
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10.  The  Tools.  Methods,  etc.,  continued: 


i.  Performance  Measurement  and  Service  Quality,  continued: 

(1)  Data  Analysis  for  Trends  and  Changes 

In  most  business  applications,  once  a  plan  is  implemented,  the  manager  needs  to 
know  how  closely  the  execution  matches  the  plan.  In  practice,  owing  to  aging  of 
even  the  most  reliable  information  used  for  planning,  there  usually  is  some 
deviation  from  the  plan.  As  time  passes,  the  size  of  this  deviation  grows,  making 
it  progressively  more  costly  to  return  to  the  planned  base  line.  Any  deviation  from 
plan  thus  becomes  a  problem. 

Feedback  analysis  provides  the  most  current  actual  information  to  compare 
the  deviating  trend  to  baseline  data  and  identify  the  corrective  measures  to  be 
applied.  As  a  problem  solving  tool,  feedback  is  imperative  for  early  problem 
identification  for  corrective  action.  Every  plan  must  therefore  provide  for 
feedback  information  from  the  outset,  to  minimize  the  waste  of  resources. 


(2)  Need  for  Consistency.  Continuity 

The  information  obtained  through  market  research  or  customer  satisfaction 
measurement  must  be  reliable,  if  it  is  to  be  used  for  corrective  action  on  a  larger 
scale.  Any  error  in  the  research  data  will  be  correspondingly  magnified  when  it  is 
applied  by  management. 

To  minimize  these  errors,  consistency  and  meticulous  attention  to  detail  are 
most  important.  When  information  is  acquired  from  respondents  it  is  essential  that 
the  same  methods  be  employed  throughout. 

Bias  is  perhaps  the  greatest  problem  faced  by  most  researchers,  and  it  must 
be  neutralized  wherever  possible  throughout  the  questionnaire  design  and  its 
administration.  Bias  can  occur  everywhere,  beginning  with  the  topic  covered, 
through  the  phrasing  of  questions,  the  positioning  of  questions/answers,  the  overall 
impression  of  the  questionnaire,  the  appearance,  attitudes  and  emphasis  of  the 
interviewer,  right  down  to  the  impact  of  prevailing  weather. 

Continuity  of  the  process  is  equally  important  for  the  identification  of 
deviation,  changes  and  trends.  The  greater  the  feedback  frequency,  the  easier  it 
becomes  to  spot  any  deviation  from  plans.  Reliability  of  this  information  is, 
however,  heavily  dependent  on  the  consistency  applied  for  successive  surveys. 


j.  Cross-tabulation  of  Data  -  Practical  Benefits 

With  the  advent  of  the  personal  computer,  the  analysis  and  presentation  of  feedback  data 
has  made  considerable  progress.  Cross-tabulating  the  results  from  several,  apparently 
very  simple  and  unrelated  questions  has  given  the  analysist  a  powerful  tool. 

For  instance,  customers’  needs  or  satisfaction  with  specific  customer  service 
components  can  be  easily  cross-referenced  with  other  data,  such  as  respondents’  timing 
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10.  The  Tools.  Methods,  etc.,  continued: 


Cross-tabulation  of  Data  -  Benefits,  continued: 

and  experience  with  the  service,  their  age,  income  group,  area  of  residence  of  work, 
education,  gender,  etc.,  to  determine  significant  differences  in  their  priorities,  attitudes, 
likes  or  dislikes  and  the  more  precise  definition  of  their  needs. 


•The  Quality  of  our  Customer  Service  compares  favourably 

with  that  of  others" 


Directors 


Senior 

Manager® 


Managers 


Supervisors 


Professional* 
&  Non -mg  ml 


□  Otaagraa 
H  Agra* 


Chart  14  -  Second-level  Analysis  reveals  Perception  Gap 


This  point  can  be  readily  illustrated  in  chart  14  above.  These  respondents  were  asked  at 
the  end  of  a  Quality  Management  Seminar  to  respond  to  the  statement:  "The  Quality  of 
our  Customer  Service  compares  favourably  with  that  of  others",  by  indicating  whether 
they  agreed  strongly,  agreed,  neither  agreed/nor  disagreed,  disagreed  or  disagreed 
strongly.  The  first  phase  analysis  did  not  reveal  anything  unexpected,  except  that  the 
number  agreeing  and  disagreeing  was  almost  evenly  divided.  Cross-tabulation  of  this 
data  with  the  position  held  by  respondents  revealed  a  noticeable  "gap"  in  perception 
between  people  dealing  with  the  public  and  managers  somewhat  more  removed  from  the 
front-line. 


k.  Customer  service  and  the  "Number-One  Syndrome" 


In  a  competitive  business  environment,  sooner  or  later  one  of  the  contestants  reaches  the 
level  of  performing  significantly  better  than  others  in  the  same  field  of  endeavour. 
Advertizing  and  promotion  literature,  television  and  print  commercials  boast  "We’re 
Number  One",  "We  are  the  best"  or  similar  superlatives. 
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10.  The  Tools.  Methods,  etc.,  continued: 


k.  Customer  service  and  the  "Number-One  Syndrome",  continued: 

While  this  promotion  is  effective  for  external  promotion,  it  can  produce  the 
opposite  impact  on  internal  staffs.  The  risk  is  to  become  complacent,  unaware  that  a 
"Number  Two"  competitor  is  "Trying  Harder"  to  out-perform  the  undisputed  winner. 

As  Chart  15  clearly  shows,  having  arrived  at  performance  levels  of  90-plus%  may 
have  satisfied  one  objective.  Another  new  one,  is  staying  there!  In  the  business 
environment,  competition  will  ensure  progress  and  improvement  -  and  start  measuring 
at  lower,  more  meaningful  measure  -  on  a  new  chart,  according  to  new  standards. 


Progressive  Improvement  of  Service  Quality 


Chart  15  -  "Are  we  Number  One  or  Number  Two?" 


DEC  outflanking  IBM  in  the  mid-’70s  with  their  mini  computers,  and  Apple  with  their 
PCs,  or  ("We’re  Number  2  -  we  try  harder")  Avis  Rent-a-Car  versus  the  -undisputed 
industry  leader,  the  "#  1  Hertz"  organization,  are  just  two  examples. 

Having  reached  "the  top"  requires  particular  vigilence  from  management,  to  ensure 
that  the  motivation  which  brought  the  business  to  its  superior  position  is  not  replaced 
with  complacency.  The  need  for  monitoring  the  environment  becomes  particularly 
important  now,  and  this  monitoring  must  focus  on  both  external  and  internal  customers, 
as  well  as  exiting  customers. 
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11.  Practical  Business  Data  Analysis 


While  the  treatment  of  marketing  research  methodology  may  imply  a  limited  application, 
exactly  the  opposite  is  the  case.  In  practice,  when  marketing  research  and  feedback  are 
employed  as  part  of  an  ongoing  process,  it  becomes  second  nature  to  secure  just  the  amount  of 
information  required,  rather  than  launch  into  a  major  project.  Smaller  projects  are  easier  to 
manage,  less  intimidating  and  produce  generall  better,  useable  results.  In  this  regard, 
experience  has  revealed  many  specific  applications  in  almost  any  area  where  the  customer  or 
taxpayer  is  served. 

a.  Practical  Application  Areas  in  Government 

Each  Ministry  will  have  its  own  needs  for  feedback.  As  an  illustration,  the 

following  Ministry  of  Revenue  applications  have  in  recent  years  benefited  from 

marketing  research  and  feedback  analysis,  for: 

•  needs  analysis  and  measuring  customer  satisfaction  levels, 

•  analysis  and  evaluation  of  telephone  information  services, 

•  identifying  customer  service  priorities  in  support  of  taxpayer  compliance 
needs, 

•  identifying  taxpayers  attitudes  with  respect  to  proposed  administrative 
changes,  including  testing  of  forms, 

•  recognizing  variations  in  needs  and  compliance  levels,  relative  to  geographic 
location  of  businesses  or  other  variables, 

«  identifying  market  potential  for  new  banking  services/branch  locations, 

•  isolating  opportunities  for  service  quality  improvements  (ESPRIT), 

•  determining  media  effectiveness  and  readership  preferences, 

•  identifying  best  business  locations  for  financial/banking  services  (POSO). 


a.  Analysis  of  Trends.  Time  Factors 

For  the  purpose  of  identifying  changes,  to  track  customer  satisfaction  levels  or 
monitor  trends,  relatively  small-scale  feedback  surveys  are  required.  For  optimum 
effect,  it  is  desirable  to  repeat  these  surveys  at  regular  intervals.  Depending  on  the 
movement,  volumes  and  risks  involved,  these  intervals  may  vary,  from  yearly, 
quarterly  to  monthly.  In  relatively  stable  business  operations,  such  as  banking  and 
government,  feedback  at  intervals  of  between  one  and  two  years  will  often  suffice. 

In  complex  business  operations  involving  several  end  user  services  such  as 
travel,  hotels,  tourism  and  tour  operations,  client  satisfaction  may  even  be  tracked 
at  weekly  intervals  during  critical  periods.  A  customer  satisfaction  index  (CSI) 
often  forms  the  centre  for  data  analysis  and  monitoring  of  customer  satisfaction 
levels. 
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12.  How  to  avoid  the  13  most  common  Market  Research  Mistakes 


Chart  16  below  summarizes  the  most  common  mistakes  made  in  marketing  research.  As 
mentioned  earlier  outset,  there  are  very  few  books  available  dealing  specifically  with 
"measuring  customer  satisfaction."  There  are,  however,  many  books  covering  the  methodologies 
of  marketing  research,  which  can  be  -  and  usually  are  -  readily  extended  to  encompass  the  need 
to  identify  customer  satisfaction  levels. 


Customer  Satisfaction 

How  to  avoid  the  13  most  common 

Customer  Satisfaction  Research  Mistakes 

i. 

Don’t  underestimate  the  Time  involved 

2. 

Learn  to  Understand  the  Business  Needs 

3. 

Limit  research  to  the  Objectives  &  Needs 

4. 

Qualify  and  respect  your  likely  Respondents 

5. 

Carefully,  carefully,  word  your  Questions  -  avoid  Bias 

6. 

Test  your  Questionnaire  -  internally  and  externally 

7. 

Be  wary  of  Excesses  -  short,  small  and  often  is  best! 

8. 

Test  and  Plan  -  allow  for  Mistakes 

9. 

A  Sense  of  Humor  doesn't  work 

10. 

Watch  out  for  the  "Destroyers" 

11. 

Hire  a  professional  Keypunching  Service 

12. 

Use  good  Software 

13. 

Don't  forget  about  Cabinet  Office  Approval 

Chart  16  -  Avoiding  Trouble  .  .  . 


Most  of  these  mistakes  are  easy  to  make  without  some  experience  in  the  field  of 
marketing  research.  On  the  bright  side,  however,  careful  attention  to  detail,  application  of 
common  sense  and  a  willingness  to  submit  to  pilot  testing  will  help  prevent  the  most  serious 
errors  and  ommissions  every  time.  Sensitivity  to  F.O.I.  legislation  is  also  important,  which  must 
be  taken  into  account  during  the  planning  phase,  regardless  whether  the  survey  is  done  in  house 
or  contracted  out. 
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13.  Cabinet  Office  Approvals  and  F.O.I. 


The  Cabinet  Office  is  responsible  for  approving  the  commissioning  of  all  public-opinion 
polls  and  market  research  studies,  including  all  questions  added  by  a  ministry  to  non¬ 
commissioned  polls.  Unless  the  proposal  involves  "market  research  which  is  limited  in 
nature  and  scope",  the  results  of  major  surveys  must  now  be  tabled  in  the  Legislature. 

The  approval  process  requires  compliance  with  a  set  of  guidelines  for  the 
preparation  of  the  business  case  to  be  forwarded  to  the  Cabinet  Office’s  Polls  and  Market 
Research  Review  Committee.  A  copy  of  the  current  guidelines  is  enclosed  at  Appendix 
"A",  starting  on  page  37. 

Marketing  Research  is  a  powerful  tool  and  should  never  be  misused,  or  used  for 
trivial  purposes.  While  this  approval  process  may  appear  soemwhat  intimidating  and 
discourage  use  of  marketing  research,  the  opposite  is  the  case.  If  the  approval  process 
requires  managers  to  think  their  research/feedback  plans  through  thoroughly,  and  if  the 
extra  time  is  allowed  for,  then  the  approval  should  be  of  little  concern. 

When  planning  your  survey  or  poll,  be  aware  that  the  results  of  virtually  any  poll 
or  survey  would  likely  be  accessible  under  the  Freedom  of  Information  and  Protection 
of  Privacy  Act.  The  planning  phase  should  allow  for  possible  timing  delays  in  the 
approval  process,  but  due  care  and  attention  will  minimize  this  possibility. 


14.  The  Limitations  of  Marketing  Research 

"Change"  is  the  one  word  that  characterizes  the  competitive  business  world  of  today.  This 
change  impacts  on  customers’  needs,  attitudes,  priorities,  and  their  ability  (or  willingness) 
to  comply  with  statutes. 

Decision-making  in  this  rapidly  changing  world  is  dependent  for  a  large  part  on  the 
validity  and  reliability  of  the  information  supplied  to  the  manager  at  all  levels. 
Marketing  research  does  not  -  and  cannot  -  make  these  decisions.  There  will  always  be 
a  need  for  managers  with  good  judgement,  intuition  and  plain  common  sense. 

Marketing  research  does,  however,  provide  the  manager  with  an  unbiased  view  of 
the  circumstances  affecting  his  or  her  particular  decision;  in  short,  it  leads  to  better, 
more  professional  decision-making.  Feedback  will  provide  the  beacon  and  guidance  for 
the  manager  to  become  more  pro-active,  to  prevent  problems,  rather  than  react  to  "unex¬ 
pected"  brushfires. 

In  todays’  competitive  marketplace  the  need  for  customer  services  continues  to 
increase.  The  needs  of  business  and  those  of  its  customers’  can  only  be  harmonized  when 
their  parameters  are  known  and  understood.  Marketing  research  can  indeed  provide  the 
necessary  information  base  leading  to  effective  improvements  in  service  levels  and 
ultimately:  Customer  satisfaction. 
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15.  And  Last:  Look  bevond  the  Obvious  .  . 


In  most  market  research  or  feedback  projects  there  will  be  frequent  occasions  when  the 
analysis  produces  unexpected  results,  or  "gaps  to  conventional  wisdom".  Revenue  has 
encountered  these  "gaps"  repeatedly  in  recent  years  (even  before  it  became  fashionable 
to  talk  about  them),  and  this  information  continues  to  help  Revenue  in  improving  its 
operations  and  customer  services. 

Earlier  encounters  with  these  gaps  -  which  invariably  impacted  adversely  on  compliance  - 
occurred  in  the  areas  of  use  of  coloured  fuel  for  unlicensed  vehicles,  in  evaluating 
developments  in  the  tobacco  markets,  locating  new  Savings  Office  branches,  and  most 
recently  in  association  with  the  ESPRIT  business-process  re-engineering  projects.  In  some 
instances,  the  variances  in  perception  were  relatively  minor,  but  with  high  volume 
operations  even  the  cost  or  correcting  small  errors  can  become  costly  and  must  be 
prevented. 

This  point  is  best  illustrated  with  one  of  those  rich  little  tales  from  Russia.  A  worker, 
upon  leaving  the  factory  at  the  end  of  the  day,  was  pushing  a  wheel  hand  cart  loaded 
with  hay.  Guards  stopped  him,  and,  noting  that  he  only  carried  hay,  allowed  him  to  exit. 
This  experience  was  repeated  on  many  occasions  until  the  worker  retired.  Sometime  later, 
a  former  colleague  visited  and  asked  the  worker:  "Tell  me,  since  you  had  no  need  for  the 
hay,  what  were  you  really  taking  from  the  factory?"  The  answer  came  back  instantly: 
"Hand  carts,  of  course!" 


16.  Useful  References 


A  list  of  recent  books  and  publications,  dealing  with  customer  service,  marketing  research 
and  service  quality  likely  to  be  of  interest  to  the  reader  is  enclosed  at  Appendix  "B", 
starting  on  page  40. 
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Appendix  "A 


Cabinet  Office  Approval:  Guidelines 

The  following  "Guidelines  for  the  Preparation  of  the  Information  Package"  or  Business  Case 
to  be  forwarded  to  the  Cabinet  Office’s  Polls  and  Market  Research  Review  Committee  are 
included  here  FOR  GUIDANCE  ONLY.  These  guidelines  are  consistent  with  a  Management 
Board  Directive  issued  in  July,  1991,  and  should  be  verified  through  your  Communications 
Branch  when  planning  your  project.  The  guidelines  require  the  following  topics  to  be 
addressed  in  the  information  package  submitted  for  approval. 


Research  Objective 

The  research  objectives  should  focus  on: 
o  what  information  you  want  to  collect; 
o  why  it  is  important; 
o  how  you  will  use  the  information; 

o  what  kinds  of  decisions  will  you  make  as  a  result  of  the  research; 
o  who  will  benefit  from  the  information. 

Strategic  Relevance 

This  section  focuses  on: 

o  how  the  research  ties  in  to  the  priorities  of  the  Ontario  government; 

o  has  there  been  consultation  with  your  Communication  and  Policy  departments; 

o  have  the  program  areas  which  will  use  the  findings  been  involved  in  the  design  of 

the  research? 

Methodology 

This  section  focuses  on: 

o  research  design  and  the  collection  methods,  e.g.,  questionnaire,  telephone,  mail, 
face-to-face,  focus  groups,  executive  interviews,  etc.; 

o  describe  the  different  populations  from  which  information  is  required,  e.g.,  the 
general  public,  or  a  specific,  more  narrowly  defined  target  group,  such  as  farmers, 
business  representatives,  government  employees,  etc.; 

o  inf ormation  requirements,  including  the  measures  (awareness,  usage,  attitude,  etc.,) 

or  data  (e.g.  demographic  details)  that  the  study  will  collect; 

o  the  sample  size  and  why  that  particular  sample  size  is  appropriate. 

Time  Lines 


o  Indicate  the  projected  start  and  completion  dates. 

o  Indicate  if  there  is  a  critical  date,  and  why,  for: 
the  commencement  of  research; 
when  the  results  are  needed. 
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Appendix  "A" 


Cost 

Indicate  the  amount  of  money  that  the  research  will  cost.  Please  estimate  a  cost,  even  if  the 
research  is  being  done  in-house  by  Ministry  staff,  (based  on  staff  hours.  Direct  Operating 
Expenses). 

Firm 


This  section  should  address  the  following  questions: 
o  Will  the  study  be  done  in-house? 
o  If  the  research  is  routine,  could  it  be  done  in-house? 
o  Will  any  or  all  parts  be  tendered? 
o  Will  appropriate  procurement  procedures  be  followed? 

o  If  it  is  not  being  tendered,  what  firm  will  be  used,  and  why  were  they  chosen? 

o  For  research  regarding  advertising  effectiveness,  the  Ministry  should  contract 

directly  with  a  research  firm  and  not  have  the  advertising  agency  select  and  sub¬ 
contract  out  to  a  research  firm. 

Related  Research 


If  applicable,  indicate: 

o  when  the  study  was  previously  undertaken; 

o  where  data  is  a  part  of  a  large  project  and  where  data  is  an  integral  component  of 
a  tracking  project; 

o  also  list  any  other  information  which  may  be  relevant  to  the  study. 

Consultations 

In  this  section,  outline: 

o  the  consultations  which  have  taken  place  with  other  Ministries,  that  might  have 
related  interests  in  the  area  of  the  (present)  research.  Ministries  should  explore 
ways  of  working  together,  sharing  findings,  sharing  costs  and  avoiding  duplication. 

o  if  no  inter-ministerial  consultations  have  taken  place,  explain  why  not; 

o  All  research  involving  advertising  must  ensure  that  the  Advertising  Review  Board 

reviews  all  proposed  advertising  first. 

Alternatives 


Indicate  in  this  section: 

o  if  there  are  any  alternatives  to  the  commissioning  of  public  opinion  polls/market 
research  for  obtaining  the  required  information.  For  example,  can  you  add-on 
questions  to  a  non-commissioned  poll?  For  more  information  on  non  commissioned 
polls  which  you  might  add-on  to,  contact  the  Ministry  of  Government  Services. 

o  If  no  alternatives  have  been  explored,  explain  why  not. 
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Distribution/Release  Plans 

All  public  opinion  polls  must  be  tables  in  the  Legislature.  Please  indicate: 

o  if  you  arc  planning  to  release  the  results  of  market  research  studies; 

o  if  so,  outline  how  the  report  will  be  released  and  if  your  communications 

department  will  be  involved. 

Contact  Name 

Name  and  telephone  number  of  the  appropriate  program  area  contact  person,  as  well  as  the 
Ministry’s  ongoing  liaison  person. 
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Some  Useful  References 


On  Customer  Service  Quality 

Customer  Satisfaction  through  Quality  -  An  International  Perspective; 

Catherine  G.  Johnston  &  Mark  J.  Daniel,  Conference  Board  of  Canada,  1991 

Achieving  Excellence  through  Customer  Service: 

John  Tschohl  (Pres.  Service  Quality  Institute)  &  Steve  Fransmeier,  Prentice  Hall,  1991 

Delivering  Quality  Service  -  Balancing  Customer  Perceptions  and  Expectations; 

V.A.  Zeithaml,  A.  Parasurmanan,  I,.  L.  Berry,  The  Free  Press/Macmillan,  1990 

Marketing  Services  -  Competing  through  Quality; 

L.L.  Berry  &  A.  Parasurman,  The  Free  Press/Macmillan,  1991 

The  Customer  Driven  Company  -  Moving  from  Talk  to  Action; 

Richard  C.  Whiteley  (The  Forum  Corporation),  Addison-Wesley  Publishing,  1991 

Creating  Value  for  Customers  -  Designing  &  Implementing  a  Total  Corporate  Strategy; 

William  A.  Band,  Coopers  &  Lybrand,  1991 

The  Service  Advantage  -  How  to  Identify  and  Fulfill  Customer  Needs; 

Karl  Albrecht  &  L.J.  Bradford,  Dow  Jones-Irwin,  1990 


Service  Within: 

Karl  Albrecht,  Dow  Jones-Irwin,  1990 


Creating  the  Service  Culture  -  Strategies  for  Canadian  Business; 
S.A.  Brown,  M.B.  Martenfeld,  A.  Gould,  Prentice-Hall,  1990 


A  Passion  for  Excellence: 

Tom  Peters  &  Nancy  Austin,  Random  House  of  Canada  Ltd.,  Toronto,  1985 


The  Complete  Guide  to  Customer  Service: 

Linda  M.  Lash  (Avis),  John  Wiley  &  Sons,  1989 

Quality  Service  Pays  -  Six  Keys  to  Success! 

Henry  L.  Lefevre,  Quality  Press  (American  Society  for  Quality  Control),  Milwaukee,  1989 

The  Customer  is  Key  -  Gaining  an  Unbearable  Advantage  through  Customer  Satisfaction; 

Milind  M.  Lele  &  Jagdish  N.  Sheth,  John  Wiley  &  Sons,  1987 

Customer  Satisfaction  -  How  to  Maximize,  Measure  and  Market  Your  Company’s  Ultimate 
Product;  Mack  Hanan  &  Peter  Karp,  American  Management  Association,  1989 

Managing  Service  as  a  Strategic  Profit  Center: 

Donald  F.  Blumberg,  McGraw-Hill,  Inc.,  1991 

Excellence  in  Government  -  Total  Quality  Management  In  the  1990s; 

David  K.  Carr  &  Ian  D.  Littman  (Coopers  &  Lybrand),  1990 
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Increasing  Customer  Satisfaction  -  Through  Effective  Corporate  Complaint  Handling; 

US  Office  of  Consumer  Affairs,  1990 

Consumer  Complaint  Handling  in  America  (3  Parts): 

TARP  (Technical  Assistance  Research  Programs  Institute),  Washington,  DC,  1986 

The  Only  Thing  That  Matters  -  Power  of  the  Customer  in  Business: 

Karl  Alrbrecht  &  TQS  Group,  Harper  Business,  1992 

Quality  in  Action: 

Patrick  L.  Townsend  &  Joan  E.  Gebhardt,  John  Wiley  &  Sons,  Inc.,  1992 

Marketing  Communications: 

Colin  J.  Coulson-Thomas,  The  Insti  tute  of  Marketing  (UK)  &  Heinemann,  London,  1986 

Marketing  Management  -  Government  and  Social  Services: 

John  L.  Crompton,  Charles  W.  Lamb,  Jr.,  John  Wiley  &  Sons,  1986; 

Marketing  Management:  Analysis.  Planning  and  Control: 

Philip  Kotler,  Prentive  Hall  International,  (5th  Ed.)  1987 


Firing  on  All  Cylinders; 

Jim  Clemmer,  Macmillan  Canada,  (2nd  Ed.)  1992 


What  every  Manager  needs  to  know  about  Marketing; 

David  J.  Freiman,  William  K.  Fallon,  amacom/American  Management  Association,  1983 


On  Marketing  Research/Feedback 

Benchmarking  -  The  Search  for  Industry  Best  Practices  that  Lead  to  Superior  Performance; 
Robert  C.  Camp,  Quality  Press  (American  Society  for  Quality  Control),  Milwaukee, 
Wisconsin,  1989 

Enjoying  Research?  -  Basic  ’How-To’  Research  Manual  on  Needs  Assessment  for  Government 
and  Community  Groups; 

Diane  Abbey-Livingston  and  David  S.  Abbey,  Ontario  Ministry  of  Tourism  and 
Recreation,  1982 

Measuring  Customer  Satisfaction  -  Development  and  Use  of  Questionnaires; 

Bob  E.  Hayes,  ASQC  Quality  Press  (American  Society  for  Quality  Control),  Milwaukee, 
Wisconsin;  1992 

Use  Research  to  analyze  Marketing  Success  -  Things  are  not  always  what  they  appear  to  be; 
James  A.  Schauer,  MARKETING  NEWS,  American  Marketing  Association  Chicago,  IL, 
Special  Market  Research  Issue:  January  4,  1985 

Development  and  Design  of  Survey  Questionnaires: 

P.  Platgek,  F.K.  Pierre-Pierre  and  P.  Stevens,  Statistics  Canada,  1985 

Practical  Marketing  Research: 

Jeffrey  Pope,  Amacom/American  Management  Association,  1981 
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A  Sampler  On  Sampling; 

Bill  Williams,  John  Wiley  &  Sons,  1978 

Low-Cost  Marketing  Research  -  A  Guide  for  Small  Businesses;* 

Keith  Gorton  &  Isobel  Carr,  John  Wiley  &  Sons,  1983 

Quality  Service  Pays  -  Six  Keys  to  Success! 

Henry  L.  Lefevre,  Quality  Press/ASQC  &  Quality  Resources,  1989 

Competing  Against  Time; 

George  Stalk,  Jr.  &  Thomas  M.  Hout  (The  Boston  Consulting  Group),  The  Free  Press  & 
Collier  Macmillan  Canada,  Inc.,  1990 

The  Marketing  Revolution; 

Kevin  J.  Clancy  &  Robert  S.  Shulman,  Harper  Business,  1991 
Kaizen: 

Masaaki  Imai,  McGraw-Hill,  1986 


Revenue/TSB/Mktg.  June  1992 
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